Papers with natural language text
SpatialWebAgent: Leveraging Large Language Models for Automated Spatial Information Extraction and Map Grounding (2025.acl-demo)
Copied to clipboard
| Challenge: | Understanding and extracting spatial information from text is vital for a wide range of applications, says nielsen . inherent complexity of geographic expressions in natural language presents significant hurdles for traditional extraction methods. |
| Approach: | They propose a system that leverages large language models to extract spatial information from natural language. |
| Outcome: | SpatialWebAgent is designed to extract, standardize, and ground spatial information from natural language text directly onto maps. |
CAMRA: Copilot for AMR Annotation (2023.emnlp-demo)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a formalism for deep lexical semantic representation. |
| Approach: | They introduce a web-based tool for constructing AMR from natural language text . CAMRA incorporates AMR parser models as coding co-pilots . |
| Outcome: | The proposed tool is based on the prototyping of existing AMR editors and integrates Propbank roleset lookup as an autocomplete feature. |
SQLPrompt: In-Context Text-to-SQL with Minimal Labeled Data (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Text-to-SQL aims to automate the process of generating SQL queries on a database from natural language text. |
| Approach: | They propose a method to improve few-shot prompting capabilities of Text-to-SQL for Large Language Models (LLMs) they propose 'SQlPrompt' which aims to diversify the SQL proposals during consistency selection with different prompt designs and foundation models. |
| Outcome: | The proposed method outperforms previous approaches for in-context learning with zero labeled data by a large margin, closing the gap with finetuning state-of-the-art with thousands of labeles. |
Answering Product-related Questions with Heterogeneous Information (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing product question answering methods only consider a single information source such as user reviews and/or require large amounts of labeled data. |
| Approach: | They propose a framework to exploit heterogeneous information including natural language text and attribute-value pairs from two information sources of the concerned product, namely product details and user reviews. |
| Outcome: | The proposed framework achieves superior performance over state-of-the-art models on a real-world dataset. |
On Robustness of Prompt-based Semantic Parsing with Large Pre-trained Language Model: An Empirical Study on Codex (2023.eacl-main)
Copied to clipboard
Terry Yue Zhuo, Zhuang Li, Yujin Huang, Fatemeh Shiri, Weiqing Wang, Gholamreza Haffari, Yuan-Fang Li
| Challenge: | Existing techniques for parsing natural-language utterances are vulnerable to adversarial attacks, requiring large amounts of labelled data and expensive human annotation. |
| Approach: | They propose to enhance the adversarial robustness of a prompt-based semantic parser based on a language model trained on code by constructing a set of demonstration examples. |
| Outcome: | The proposed method can be enhanced without significant amounts of labelled data or expensive human annotations on in-domain semantic parsing data. |
CoSe-Co: Text Conditioned Generative CommonSense Contextualizer (2022.naacl-main)
Copied to clipboard
| Challenge: | Pre-trained language models (PTLMs) have been shown to perform well on natural language tasks. |
| Approach: | They propose a commonsense contextualizer conditioned on sentences as input to make it generically usable in tasks involving natural language text. |
| Outcome: | The proposed model improves on existing methods on CSQA, ARC, QASC and OBQA datasets. |
Facts That Matter (D18-1)
Copied to clipboard
| Challenge: | Existing methods to discover facts from natural language text are based on relation extraction and open information extraction. |
| Approach: | They propose a task of generating a machine-readable representation of the most prominent information in a text document as a set of facts. |
| Outcome: | The proposed system outperforms baselines and text summarizers in a supervised evaluation of salience tasks. |
Faithful Low-Resource Data-to-Text Generation through Cycle Training (2023.acl-long)
Copied to clipboard
| Challenge: | Methods to generate text from structured data have advanced significantly in recent years, but can fail to produce output faithful to the input data, especially on out-of-domain data. |
| Approach: | They evaluate the effectiveness of cycle training by using two models which are inverses of each other to generate text from structured data and one which generates the structured data from natural language text. |
| Outcome: | The proposed approach achieves nearly the same performance as fully supervised approaches on the WebNLG, E2E, WTQ, and WSQL datasets. |
Image Manipulation via Multi-Hop Instructions - A New Dataset and Weakly-Supervised Neuro-Symbolic Approach (2023.emnlp-main)
Copied to clipboard
Harman Singh, Poorva Garg, Mohit Gupta, Kevin Shah, Ashish Goswami, Satyam Modi, Arnab Mondal, Dinesh Khandelwal, Dinesh Garg, Parag Singla
| Challenge: | Recent studies have shown that neuro-symbolic models lack interpretability and are not robust to noise. |
| Approach: | They propose to extend Neuro Symbolic Concept Learning (NSCL) which has been quite effective for the task of Visual Question Answering (VQA) they create a new dataset for the image manipulation task and demonstrate that NeuroSIM is highly competitive with or beats SOTA baselines that make use of supervised data for manipulation. |
| Outcome: | The proposed system performs complex multi-hop reasoning over multi-object scenes and only requires weak supervision in the form of annotated data for VQA. |
Timeline-based Sentence Decomposition with In Context Learning for Temporal Fact Extraction (2024.acl-long)
Copied to clipboard
| Challenge: | Recent research on temporal fact extraction fails to establish time-to-fact correspondences in complex sentences. |
| Approach: | They propose a timeline-based sentence decomposition strategy using large language models with in-context learning to extract temporal facts from natural language text. |
| Outcome: | The proposed method achieves state-of-the-art on a complex temporal fact extraction dataset. |
Efficient Constituency Tree based Encoding for Natural Language to Bash Translation (2022.naacl-main)
Copied to clipboard
| Challenge: | Semantic parsing is one of the central tasks for natural language understanding (NLU). |
| Approach: | They propose a Segmented Invocation Transformer that utilizes the information from the constituency parse tree of the natural language text and Bash command components to generate Bash commands. |
| Outcome: | The proposed method improves the inference time and reduces the model parameters by 1.8x . |
Database reasoning over text (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models cannot handle database queries such as “List/Count all female athletes who were born in 20th century”. |
| Approach: | They propose a modular architecture to answer database-style queries over multiple spans from text and aggregate them at scale. |
| Outcome: | The proposed architecture scales to databases containing thousands of facts whereas current models are limited by how many facts can be encoded. |
Generating Realistic Natural Language Counterfactuals (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to explain ML tasks for natural language text are either unrealistic or introduce imperceptible changes. |
| Approach: | They propose a method that combines a conditional GAN and embeddings of a pretrained BERT encoder to model-agnostically generate realistic natural language text counterfactuals for explaining regression and classification tasks. |
| Outcome: | The proposed method outperforms baseline methods on fidelity and human judgments of naturalness across multiple datasets and multiple predictive models. |
SPARTQA: A Textual Question Answering Benchmark for Spatial Reasoning (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing studies have focused on the spatial reasoning capabilities of modern language models (LMs) however, there has been limited research into the spatial thinking capabilities of LMs. |
| Approach: | They propose a question-answering (QA) benchmark for spatial reasoning on natural language text which contains more realistic spatial phenomena not covered by prior work. |
| Outcome: | The proposed method significantly improves LMs' ability on spatial understanding, which in turn helps solve two external datasets, bAbI, and boolQ. |
Syntactically Rich Discriminative Training: An Effective Method for Open Information Extraction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Open information extraction (OIE) is the task of extracting facts from natural language text. |
| Approach: | They propose a method for computing syntactically rich text embeddings using the structure of dependency trees and a discriminative approach to OIE where tokens in the generated fact are classified as "real" and "fake" they propose to reduce repetitive tokens and improve models' ability to generate implicit facts by a factor of 23%. |
| Outcome: | The proposed method reduces repetitive tokens by a factor of 23% on the CaRB, OIE2016, and LSOIE datasets and improves on augmented datasets. |
AutoML Strategy Based on Grammatical Evolution: A Case Study about Knowledge Discovery from Text (P19-1)
Copied to clipboard
| Challenge: | Recent advances in Automatic Machine Learning (AutoML) provide effective tools to explore large sets of algorithms, hyper-parameters and features to find out the best combination of them. |
| Approach: | They propose a novel AutoML strategy based on probabilistic grammatical evolution to explore the best combination of parameters and features to use when dealing with the knowledge discovery challenge in Spanish text documents. |
| Outcome: | The proposed strategy achieves state-of-the-art and provides interesting insights into the best combination of parameters and algorithms to use when dealing with this challenge. |
Linking Surface Facts to Large-Scale Knowledge Graphs (2023.emnlp-main)
Copied to clipboard
| Challenge: | Open Information Extraction (OIE) methods extract facts in the form of triples . ambiguity of these triples hinders their downstream usage . |
| Approach: | They propose a benchmark that measures fact linking performance on a granular triple slot level . they propose to use a system that can detect out-of-KG entities and predicates . |
| Outcome: | The proposed benchmark can measure fact linking performance on a granular triple slot level while also measuring if a system can recognize that a surface form has no match in the existing KG. |
ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training (2024.acl-long)
Copied to clipboard
Le Zhuo, Zewen Chi, Minghao Xu, Heyan Huang, Jianan Zhao, Heqi Zheng, Conghui He, Xian-Ling Mao, Wentao Zhang
| Challenge: | Experimental results demonstrate that ProtLLM achieves superior performance against protein-specialized baselines on protein-centric tasks and induces zero-shot and in-context learning capabilities on protein language tasks. |
| Approach: | They propose a cross-modal large language model (LLM) that can handle protein-centric and protein-language tasks by using a dynamic protein mounting mechanism. |
| Outcome: | The proposed model can predict proteins from a vast pool of candidates and can also predict natural language and biological papers. |
Let the CAT out of the bag: Contrastive Attributed explanations for Text (2022.emnlp-main)
Copied to clipboard
| Challenge: | XAI has seen an explosion of interest in explaining black box behavior . contrastive/counterfactual explanations have seen a surge of interest recently . |
| Approach: | They propose a method which provides contrastive explanations for natural language text data with a novel twist by exploiting attribute classifiers. |
| Outcome: | The proposed method outperforms state-of-the-art methods on four benchmark metrics. |
Table-To-Text generation and pre-training with TabT5 (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) are limited when it comes to structured or semi-structured domains like tables. |
| Approach: | They propose an encoder-decoder model that generates natural language text based on tables and textual inputs. |
| Outcome: | TabT5 achieves 15% increase in sequence accuracy on spreadsheet formula prediction and data-to-text generation domains. |
TAME-RD: Text Assisted Replication of Image Multi-Adjustments for Reverse Designing (2024.findings-acl)
Copied to clipboard
Pooja Guhan, Uttaran Bhattacharya, Somdeb Sarkhel, Vahid Azizi, Xiang Chen, Saayan Mitra, Aniket Bera, Dinesh Manocha
| Challenge: | a new model to reverse design images can be used to replicate image edits on other images based on human instructions in natural language . a study of a dataset of 100K source and edited images shows improvements in accuracy and concordance correlation coefficient . |
| Approach: | They propose a reverse-designing model that automatically learns from image editing operations and natural language instructions to learn fully specified edit operations. |
| Outcome: | The proposed model improves accuracy and concordance correlation scores on multiple datasets. |
Systematic Comparison of Neural Architectures and Training Approaches for Open Information Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Open information extraction (OIE) is a method for extracting facts from text in structured format . alternative formulations allow for longer tuples, but most work focuses on binary predicates only. |
| Approach: | They propose to extract facts from natural language text and represent them as structured triples . they compare different neural network architectures and training approaches . |
| Outcome: | The proposed approach improves the currently best models on the OIE16 benchmark by 0.421 F1 score and 0.420 AUC-PR . |
“Was it “stated” or was it “claimed”?: How linguistic bias affects generative language models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Several studies have identified such linguistic classes of words that occur frequently in natural language text and are bias-inducing by virtue of their framing effects. |
| Approach: | They propose to use linguistic cues to induce subtle biases through implied sentiment and presupposed facts to influence the distribution of the generated text. |
| Outcome: | The proposed models are sensitive to these framing effects, but show that they lead to measurable style and topic differences in the generated text, leading to language that is, on average, more polarised and more skewed towards controversial entities and events. |
Unsupervised Sign Language Translation and Generation (2024.findings-acl)
Copied to clipboard
Zhengsheng Guo, Zhiwei He, Wenxiang Jiao, Xing Wang, Rui Wang, Kehai Chen, Zhaopeng Tu, Yong Xu, Min Zhang
| Challenge: | Experimental results on the BBC-Oxford Sign Language dataset reveal that USLNet achieves competitive results compared to supervised baseline models. |
| Approach: | They propose an unsupervised sign language translation and generation network that learns from abundant single-modality data without parallel sign language data. |
| Outcome: | The proposed model achieves competitive results compared to baseline models on the BBC-Oxford Sign Language dataset and Open-Domain American Sign Language data. |